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In a previous paper, a method was presented to integrate numeri- 
cally nonlinear stochastic differential equations (sdes) with additive, 
Gaussian, white noise. The method, a generalization of the Runge- 
Kutta algorithm, extrapolates from one point to the next applying 
functional evaluations at stochastically determined points. This pa- 
per extends (and at one point corrects) algorithms for the simple class 
of equations considered in the previous paper. In addition, the method 
is expanded to treat vector sdes, equations with time-dependent 
functions, and sdes higher than first order. The parameters for 
several explicit integration schemes are displayed. 

I. INTRODUCTION 

There are two approaches to the study of a physical system described 
by a stochastic differential equation (sde). On the one hand, one may 
work with an equation for the probability distribution function for the 
random variables such as the Fokker-Planck equation. On the other 
hand, one may attempt to generate representative points on a trajec- 
tory by direct solution of the sde. With either approach it is rare that 
analytical solutions can be found, except for linear systems. While the 
deterministic equation for the probability distribution can be solved 
numerically with standard techniques, in practice there are great 
difficulties. Numerical techniques for sdes are a less-developed subject, 
but quite promising since they are capable of giving direct information 
about the random process, such as the power spectrum, higher mo- 
ments, and transition rates. Several discussions of the problem have 
been published. 1 

A previous paper 2 (hereafter referred to as I) describes a systematic 
approach to the numerical solution of sdes. Attention was limited to 
the simple one-variable equation of the form 

1927 



^ = f(x)+A(t), (1) 

at 

where f(x) is a differentiable function through some order, and A (t) is 
a Gaussian white noise source with 

<A(f))-0L (2) 

(A(t)A(f))=&(t-?)- (3) 

The procedure introduced was an extension of the Runge-Kutta 
method for numerical solution of deterministic differential equations. 
In the Runge-Kutta technique, as applied for instance to dx/dt = f{x), 
f(x) is evaluated at x(t) and a number of other definite points. From 
these evaluations an extrapolation from x(t) to an estimate, x(t + h), 
is constructed which is accurate to a given order in the time step, h, 
i.e. errors are less than order h k . To apply this procedure for sdes, the 
function f(x) is evaluated at stochastically selected points. The algo- 
rithm is such that all moments of x (t + h) — x(t) are correct to the Ath 
order in the step size h. 

In this paper, we continue and extend the work begun in I in two 
ways. First, we discuss further the algorithms given in I. The two 
possible second-order algorithms described earlier are generalized to 
two families of parameter sets. A third-order algorithm proposed in I 
was in error and is corrected. We go on to consider a fourth order four- 
stage algorithm, but report our inability to find one. Our analysis 
suggests that Ath order A-stage algorithms do not exist for k > 4. 

The second way in which we extend the discussion in I is to 
generalize the method to three other classes of sdes. The first class is 
vector sdes in which each component has its own independent Gaus- 
sian noise source: 

^E-f(x) + A(t). (4) 

dt 

This generalization may then be applied to the study of the class of 
sdes in which f is an explicit function of both x and t. Also we show 
how to handle sdes which are higher than first order (higher order 
derivatives of x with respect to t appear).* 

In Section II, we briefly review the previous work and introduce the 
nomenclature. Section III contains a discussion of explicit algorithms 
which may be used for one-variable sdes such as eq. (1). In Section IV 
we discuss the integration of vector sdes and how to solve time- 
dependent and higher-order systems. This is illustrated in Section V 



* A discussion on how our method may be applied to sdes with multiplicative random 
variables will be presented elsewhere (H. S. Greenside, to be published). 
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with an explicit, third-order, vector algorithm. Finally, we indicate 
some new directions which seem important to explore. 

II. REVIEW AND NOTATION 

A convenient way to solve an sde such as eq. (1) is to rewrite it as 
an integral equation 

x(h) = x(0) + dsf[x(s)] + w l0] (h), (5) 



where 

w m (t) = I dsA(s) (6) 



o 
is the Wiener process. We later need the iterates of w [oi defined by 

w [ni (t) = ds w [n - 1] (s). (7) 

Jo 

The w [ni are Gaussian random variables with zero mean and covari- 
ances given by eqs. (18) and (19) of I. One can expand the right-hand 
size of eq. (5) in a series in h 1/2 , where the order of the stochastic terms 
is determined in probability. The result is 

x(h) = x + hf+ Vih 2 ff + (Ve)h 3 ( ff' 2 + f 2 f") + ■■■ + S(h), (8) 
where the stochastic part is given by 

S(h)= {w w (h)) 1/2 + {f'w [,i (h)} V2 

+ [|r [ ds[w^( S )f 



+ \f' 2 w m (h) +ff"[hw lu (h) - w™(h)] 
+ (l)f" \ ds[w^(s)f 

+ |j rr ( J ds & - s)[w w ( S )] 2 + [w [i] (h)A 
1 f 

+ -ff" dss[w [0] (s)] 2 

-h 

+ I ^7 ) r " I ds [w w (s)Y \ + • • ■ . (9) 



fe) / 1*^«4 
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[Note that in the equation for S(h) in I, eq. (114), the third-order term 
involving f'f" was incorrectly given.] We have written x for x(0), and 
f {n) indicates the nth derivative of /"evaluated at x = Xo. In S(h) terms 
of order h J in probability have been gathered together in braces and 
the subscript j placed after the braces. The moments of the stochastic 
variable S(h) are, to third order in h, 

(S) = l Ah 2 tr + h 3 (V4f f f" + V4ff" + MY"') + • • • , do) 
<s 2 > = hi + h 2 £f + hHHf' 2 + %ZfT + KCY" ) + ■•-. (ID 

<S 3 > = (7/4)h 3 £ 2 f"+ •••• (12) 

(Note that the coefficient of f'f" in (S) is in error in I and is corrected 
here.) For the expansion through order h k the terms of S nonlinear in 
the a/s, hence non- Gaussian, do not contribute to moments higher 
than 2k - 1. It follows that if errors in <S 2 > are reduced to 0(h h+1 ) 
then errors in (S n ), n > 2k - 2, will be that order or higher order in h. 
In I it was proposed to integrate the sde, eq. (1), by an extension of 
the Runge-Kutta scheme. 3 The algorithm for an I stage procedure is 
as follows: 

gi-fixo + hW^YJ, (13) 

g 2 = f(x + hfagi + h 1/2 e /2 Y 2 ), (14) 

gi = f(xo + hfingi + • • • + hfrj-igi-i + h y2 i x/1 Y,), (15) 

x = xo + h(A igi + • • • + A lgl ) + h i/2 e /2 Yo. (16) 

The I + 1 stochastic variables Yo, • • • , Yj are Gaussianly distributed 
with mean zero and covariance 

{YiYj)=Lij. (17) 

The matrix L, being symmetric, has x h(l + l)(l + 2) independent 
parameters. Numerically, it is convenient to generate the Y set by 
writing 

Yj^KZ,,. (18) 

n=l 

where the Z's are a set of independent Gaussian random variables with 
mean zero and variance unity. Note particularly that in eq. (18) only 
j + 1 variables Z p need be used to define Yj. The Xj„ form / + 1 vectors 
of / + 1 components 

Xo= {Aoi,0,0, ..-,0), (19) 

Xi = {X„,A 12 ,0, •••,0}, (20) 

A/ = {A/i, A/2, A/3, • • • , A/,/+i}. (21) 
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The Vfc(/ + 1)(Z + 2) parameters A/„ are related to the same number of 
independent parameters in the symmetric L matrix by 

Lij = Xi-Xj (22) 

The algorithm eqs. (13) to (16) can be expressed as a power series in 
h 1/2 , there being a deterministic part and a stochastic part, S. In turn, 
the moments of the stochastic part can be expanded in powers of h. 
(A two-stage, second-order illustration is given in I.) Each term of the 
deterministic part and of the moments takes the form of: (a power of 
h) X (a power of |) X (a product of powers of / and its derivatives) X 
(a coefficient which is a function of the parameters A,-, /?,>, and A/„). 
Corresponding terms occur in the expansion, eq. (8), and in the 
moments of S(h) given by eq. (9), except that in the latter cases the 
coefficients have definite numerical values. Therefore, equations for 
the parameters are obtained by equating the two coefficients for each 
different term (i.e., different product of f and derivatives) through a 
given power, h h . The series match independently of the explicit form 
of/(jc). 

There are (I + l) 2 parameters: A, (i = 1, • • • , I); fiij (i = 2, •••,/, and 
y = l, • • • , i — 1); Xij (i = 0, •••,/, andy = 1, ■ • • , i + 1). There may be 
fewer conditions to be satisfied than this. If so, it is convenient to use 
only m rather than 1+ 1 Gaussian random variables, Z p . This amounts 
to setting \y p = for p > m. 

A procedure which is correct through order h k , which involves / 
stages, and which utilizes m Gaussians will be called a kohmG algo- 
rithm. Explicit examples are given in Section III. 

III. THE 2 2 s 1 o, 3 3 S 2 G , AND OTHER ALGORITHMS 

In I the parameters were displayed for a 2o2s1g algorithm. There is 
one degree of freedom (6 parameters, 5 equations). The most general 
choice of parameters is 

A, = 1 - VkT\ 

A 2 = V2a'\ 

#n = a, 

Aoi = 1, 

An = y 2 [l ± (2a - 1)" ,/2 ], 

A21 - V 2 [l + (2a - 1) 1/2 ], (23) 

with a > V2. In I the solutions with a = 1 were suggested as particularly 
convenient. 
In the Appendix of I, a discussion of the 3o3s2g algorithm was 
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presented. The exposition contained an error and should be disre- 
garded. A proper discussion follows. 

The 16 - x h(A — m)(5 - m) parameters of a 3o3sm.G algorithm must 
satisfy 14 equations obtained by matching the expansion of eqs. (13) 
to (16), and the expansion of eq. (8) and moments of eq. (9): 



2 At = i, 


(24) 


3 

2 Am = y 2 , 

i'-2 


(25) 


2 AttA = % 

i-2 


(26) 


A 3 /? 32 /?2i = Vs, 


(27) 


Loo = lj 


(28) 


2 AiLoi = l /2, 
i-i 


(29) 


2 AiLu = % 


(30) 


2 A,Lh = v 3 , 
i=i 


(31) 


2 AiLl = Vs, 
«=i 


(32) 


3 

2 AiLoiLu = y 3 , 

i-l 


(33) 


3 

2 Ac*!*- = %, 

J=2 


(34) 


3 

2 AiOtiLoi = %, 

i=2 


(35) 


2 a, j ^(Ly + KLjj) = y 4 , 

i=2 y=l 


(36) 


A/L« + 2U V ft,l* = %, 


(37) 



3 3 

2 I 

i=ly = l i=2 7-1 

where, by definition, 

i-i 

at = 2 A>. » = 2, 3. (38) 

y-i 
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A remarkable simplification occurs if we assume 
Ax = 0, 
Loi = La = a,, i = 2, 3 



(39) 
(40) 



(it can be shown that no real solutions exist without these conditions). 
Then the 14 equations, eqs. (24) to (37), reduce to 7 independent 
equations in 8 unknowns for a 3o3s2g algorithm. This leaves one 
degree of freedom which we can take as a 2 . We are, of course, only 
interested in solutions for which all the parameters are real. This 
requires that 

< a 2 < Va or % < a 2 < 1. (41) 

Since some of the equations are nonlinear, there are multiple solutions 
in certain regions. Further details are presented in the Appendix. Table 
I gives an indication of the behavior of the parameters as a 2 is varied. 
Since A J2 is obtained from the solution of a quadratic equation, two 
choices are shown. As a 2 increases through 0.247583, a new pair of real 
roots of the equations appears, while at 0.2689703 the other pair 
becomes complex. There are four roots in the range % < a 2 < 1 
(although at % and 1, roots are degenerate). The parameter set 
corresponding to a 2 = % looks particularly interesting because all 



Table I — Parameters for 3 3 S 2 G algorithms appropriate to a one- 
variable SDE* 



Otl\ 




fin 


A, 


\n 


X, s 




A32 


0.1 




-1.82639 


0.34247 


0.03341 


-1.14271 


0.22458 


0.45453 


0.2 




-0.82716 


0.48077 


0.12491 


-1.15128 


0.31072 


0.41574 


0.25 




-0.72222 


0.57143 


0.24733 


-0.90403 


0.26211 


0.37268 










-0.22692 


0.81865 


1.30789 


-0.37268 


0.30 




-0.79630 


0.67568 


-0.31442 


0.19962 


5.71406 


-0.27639 


% 




-1.0 


% 


-V12 


0.61844:): 


-2.50406:): 


0.0 


0.7 




-0.65079 


0.67568 


-0.14525 


0.67143 


-1.88108 


0.27639 










0.06670 


0.47809 


-2.57869 


-0.27639 


0.8 




-0.17901 


0.48077 


-0.14275 


0.63842 


-1.42839 


0.41574 










0.14191 


0.46368 


-1.78360 


-0.41574 


0.9 




0.01003 


0.34247 


-0.12381 


0.63799 


-1.24446 


0.45453 










0.07126 


0.64299 


-1.21137 


-0.45453 


1.0 




% 


y« 


-Vis 


0.76579§ 


-1.00149§ 


2 ,/2 /3 


•The 


parameters not listed are 


given by: 








/?21 = 


a 2 














#,2 = 


l/(&4 3 a 2 ) 












A, = 

















Ai = 


1- 


A» 












A21 — 


a 2 














A22 = 


+ (a 2 - uj 












fci- 


fa 


+ 032 













t a2 is varied as the one degree of freedom, 
i ±39 1/2 /4 - 2 3/2 /3. 
§ -2 1/2 /12 ± 1799 l/2 /48. 
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parameters are <Sl, and aa = A31 = A32 = 0. A second interesting 
parameter set is the one for 0:2 = 1. 

A 3o4s2g solution will be discussed in Section IV. In this case, there 
are enough degrees of freedom so that the parameters can be selected 
to produce an algorithm which integrates the deterministic part of the 
equation through fourth order. 

It is straightforward, but quite lengthy, to extend all of the equations 
in Section II to fourth order. We have done so. For a Ao^sttig algorithm, 
there are 25 — V4(5 — m)(6 — m) parameters which must satisfy 29 
equations (39 coefficients must be matched but 10 of the resulting 
equations are not independent). The assumption that A\ = and 
Loi = La = ct\, i = 2, 3, 4, reduces the number of unknowns to 18 — 
'/6(5 — m)(6 — m); and, remarkably, the number of independent 
equations is reduced to 18. Thus, there may be solutions with 5 
Gaussians (the maximum possible). Unfortunately, after a reasonably 
thorough search for solutions we were not able to find any real 
solutions.* Although we do not have a proof that no real solutions 
exist, it appears that there is no 4o4sWIg algorithm. 

IV. ALGORITHM FOR VECTOR SDEs 

Consider next vector sdes of the type 

^ = f(x) + A(f), (42) 

at 

with 

(AM) =0, 

(A K (t)A ll (t'))=Z K 8 Kll 8(t-t'). (43) 

If the A covariance matrix is not diagonal, then linear combinations of 
the equations can be taken to diagonalize it, or the algorithm described 
below can be modified. 

In a fashion analogous to that used to obtain eqs. (8) and (9) one 
can write (using the summation convention on repeated indices) 

xM - x 0k + hf K + *&&%,£ 

+ (Ve)h 3 ( UM*f* + LM*) + ' • • + SJh), (44) 



* The algebra involved in many of these calculations is extremely lengthy. Occasion- 
ally it is susceptible to simplification by a combination of equations. For these reasons, 
we would be willing to provide further details of our calculations to interested parties. 
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SAh) = {w [ : i (h)) m + {L,w^h))vi 

+ \LJ,...iv™(h) + f K ,Mhw[ ll (h) + w™(h)] 
+ (g)/U.[ d8w^(s)w?Hs)w^(8)] 
+ \\ Mm I ds (h - s)w™(s)wM(s) 



Jo 
+ A,,,/,p I ds wP(8)wP(8) 

Jo 

•h 



+ \f*«r P f P J ds SIV [ ? 1 (S)W [ ? ] {S) 

+ (j£\ /*,.,,„ [ ds WF(8)WF(8)U>F(8)WW(8)\ 

+ ■■■, (45) 



^ p= i^;•■•i /K|x=x,o, ' (46) 



where 



wPU)- rfsi«(s), (47) 

Jo 

with w[" ] being the nth iterate of w\^. There is one major difference to 
note between eqs. (45) and (9). In the former, a distinction must be 
made between the term with f Kjll f^ and that with f K ,^f„, p ; in the latter, 
both are f'f" . This leads to an extra equation which the parameters 
will have to satisfy for sets. Such differences first enter in fourth order 
for sets of deterministic differential equations, while for sdes they 
enter at third order. 

The earlier algorithm for numerical integration is easily generalized 
to 

gu^fAixor + hW^Yi,}), (48) 

Zu = /»({*>„ + hfagt, + /i 1/2 £,.Y2„}), (49) 
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gu = /,({*<* + hfing!, + • • • + hPu-igi-i* + h i/2 ej 2 Y tll }), (50) 

x K (h) = x 0K + h(A lglK + • • • + A lglK ) + h m e /2 Y 0K , (51) 

where {* M } denotes the set of variables Xi, • • • , Xn. It is appropriate to 
take the covariance of the Yu as 

<y ilc Yy M >=L i A /1 ; (52) 

or, equivalently, to write 

Y k = l KjZ JK , (53) 

where the Z y>t are Nm independent Gaussian random variables of mean 
zero and variance unity. In general, m = I + 1, but it may be possible 
to construct an algorithm with smaller to, i.e., a kotemG scheme for 
vector sdes. 

Equation (51) may be expanded to any desired order, h k , giving a 
deterministic and a stochastic part, S. Once again, equations for the 
parameters are determined by demanding equality of the deterministic 
part to that of the expansion, eq. (44). Further equations result from 
equating the moments of S and S. In general, there are more equations 
to be satisfied for sets than for a single variable because of the mixed 
partial derivatives. Note, however, that the parameters for the 
algorithm, Ai, f$ij, \ij, are not functions of the component 
index, k. 

Once an algorithm is available for vector sdes, it can be applied to 
two other classes of sdes. Consider the generalization of eq. (4) where 
f is time dependent 

^ = f(x, t) + A(*). (54) 

at 

By introducing an extra variable ^w+i = t (i.e., dxN+\/dt = 1), one can 
rewrite eq. (54) in the form eq. (42) as an N + 1 dimensional, 
autonomous vector sde: 



^ = F(y) + A(t), 


(55) 


y = (xi, x 2 , • • • , x N , x N+i ), 


(56) 


F(y) = (f u f 2 , ■••,/*, 1), 


(57) 


£ = (1., b, • • ■ , U 0). 


(58) 



In this case, the random variables Y,,n+i or Z,,n+i need not be generated 
since they are always multiplied by zero. 

An nth order differential equation may also be integrated in a 
straightforward manner. Consider as an example the simple case 
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d n x d n ~*x 

— + ci(x) -£- + • • • + cn(x) = A(t). (59) 

This equation is equivalent to the n dimensional vector sde 



rfyN- 






- = y», (61) 

= —c\(y\)yN-\ - c 2 (yi)yN-2 - ... - ci(yi) + A(f). (62) 



dt 

Note that 

£ - (0, 0, • • • , 0, {) (63) 

so that only one Gaussian variable is needed per time step. More 
complicated equations than eq. (59) are just as easily handled; e.g., 
equations nonlinear in the derivatives and equations with an explicit 
time dependence on the left. 

V. PARAMETERS FOR VECTOR SDE ALGORITHMS 

To second order, the equations for the vector algorithm parameters 
are identical with those of a single equation. Thus, the parameters 
given earlier in eq. (23) may be used for a vector 2o2s1g scheme. 

To third order, one new equation enters. All the eqs. (24) to (38) 
hold except that eq. (36) splits into two (because of the difference of 
mixed derivatives): 

SAJjM^-1. (64) 

i-2 y-1 b 

EAEto-j. (65) 

i-2 y-i o 

The one degree of freedom of the one- variable 3o3s2g algorithm is now 
removed, but a solution might still exist. Unfortunately, no real solu- 
tion can be found regardless of whether there are 2, 3, or 4 Gaussians. 
In order to find a third-order algorithm, it was necessary to consider 
a 3o4s2g procedure, that is, to add a stage. This leaves many degrees 
of freedom — in fact enough so that the deterministic part of the 
equation could be satisfied to fourth order with one degree of freedom 
left. Actually, these extra degrees of freedom only exist if one assumes 
[in the pattern of eqs. (39) to (40)] that 

Ax = 0, (66) 
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Ui = La = cti, i = 2, 3, 4. (67) 

Since the parameter equations are nonlinear there are multiple families 
of solutions. We have not explored all the branches, but have looked 
particularly at a branch for which a 4 = 1. This implies that A4 = 
(1, 0, • • .). In Table II we present two parameter sets which can be 
used for the 3o4s2g algorithm with 4o deterministic-part accuracy. We 
have the parameters for three other families of solutions but have not 
presented them because some parameters are large, i.e., 2: 5. The 
degree of freedom is in the relation between An and A J2 which is 

J Aictifa) An + f J AAafiaj A, 2 - f|j - £ At J faUj. (68) 

All the parameters in this equation except X u and A 12 are determined 
by other equations. In Table II we present two solutions, for which 
A12 = and An = 0, respectively. 

From the point of view of computer time, a 3o4s2g algorithm might 
be faster than a 3o3 s 4c algorithm (if the latter existed); i.e., an extra 
functional evaluation may be faster than generating more Gaussians. 
For problems in which the effect of noise is small (small £) the 3o4 s 2c 
algorithm, being fourth order in the deterministic part, would be more 
accurate. 

VI. CONCLUSION 

In Section IV, we considered various koksiriG algorithms and found 
that for the one variable problem there were 5, 14, and 29 equations to 
be satisfied for k = 2, 3, and 4, respectively. On the other hand, the 
numbers of parameters available to satisfy these equations are maxi- 
mally (k + l) 2 = 9, 16, and 25, respectively. It appears that the number 
of equations is increasing more rapidly than the number of parameters. 
[The situation is complicated for a number of reasons: (i) assumptions 
like eqs. (39) and (40) seem capable of reducing the number of equa- 



Table II — Parameters for a 3 4 S 2 G algorithm 
appropriate to vector SDEs 



A, 


0.0 


A 2 


0.644468 


A, 


0.194450 


A, 


0.161082 


fa 


0.516719 


031 


-0.397300 


fin 


0.427690 


fa 


-1.587731 


A01 


1.417263 


043 


1.170469 


1.0 


A02 


0.0 


A„ 


0.0 


A]2 


0.271608 


or 

An 


-0.567253 


A12 


0.0 


A21 


0.516719 


A22 


0.499720 


A,-ji 


0.030390 


A32 


-0.171658 


A41 


1.0 


A42 


0.0 
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tions considerably; (ii) even when there are sufficient parameters real 
solutions do not always exist; and {Hi) vector sdes produce more 
equations with the same number of parameters.] To achieve a third- 
order algorithm for sets it was necessary to use four stages, and our 
failure to find a 4 4s algorithm in Section III probably means that at 
least a fifth stage is necessary. A similar situation occurs for determin- 
istic equations, in which case more than k stages are needed when the 
order of accuracy is k > 5. 4 

Higher order methods can be achieved in other ways than by 
increasing the number of stages. One possibility, suggested in I, would 
be to adapt iterative multistep methods, e.g., of the Adams-Moulton 
type. 3 Another approach would be to use implicit Runge-Kutta meth- 
ods in which later stage g/s are used in earlier stage gfa. 4 An /-stage 
implicit method would then require the self-consistent solution of I 
nonlinear equations for the Igi'a at each time step. For mildly nonlinear 
sdes and small fluctuations of the stochastic parts, this could be more 
efficient than larger stage methods. It is known that deterministic 
implicit methods are capable of achieving &th order accuracy with 
fewer than k stages, so this could well be the case for sdes also. 

It is our hope that the work presented here and in I, besides 
providing some practical schemes for integrating sdes, will stimulate 
further research on this interesting and important topic. 
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APPENDIX 

We briefly present further details of the solution of the equations 
for the parameters of the 3o3.s-2c algorithm to illustrate the procedures 
which one follows in cases of higher order or more stages. 

The seven independent equations to be solved, after assuming eqs. 
(39) and (40), are eqs. (24) to (28), (36), and (37). The eight unknowns 
may be taken as a 2 , <x 3 , A 2 , A a , /? 32 , Aoi, Am and Ai 2 . Other A parameters 
are given by 

A 21 = on, (69) 

A.3, = a 3 , (70) 

A 22 = +(a 2 - al) ,/2 , (71) 

A 32 = ±(«a - al) i/2 . (72) 

(The use of the negative sign for A22 changes all signs for the A, 2 's, and 
is a trivial modification equivalent to changing the sign of Z 2 .) 
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Equations (24) to (26) may be solved for Ai, A>, and A :i in terms of 
a-z and a.3. Setting A 1 = leads to 

* 3 = 6^I- (73) 

By eqs. (71) and (72) we see that both <x-z and a ;) must be between zero 
and unit, for a real solution, which, coupled with eq. (73), implies 
inequality eq. (41). 

The remaining parameters are solved for as follows: eq. (27) yields 
/? :J2 in terms of parameters now dependent only on a>; eq. (28) dictates 
A01 = 1, which is true for every algorithm; eq. (36) is a linear equation 
for An; and eq. (37) is a binomial equation for A12. 
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